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Abstract 

Herein, we present a detailed analysis of an eigenvalue based sensing technique in the presence of correlated 
noise in the context of a Cognitive Radio (CR). We use a Standard Condition Number (SCN) based decision statistic 
based on asymptotic Random Matrix Theory (RMT) for decision process. Firstly, the effect of noise correlation on 
eigenvalue based Spectrum Sensing (SS) is studied analytically under both the noise only and the signal plus noise 
hypotheses. Secondly, new bounds for the SCN are proposed for achieving improved sensing in correlated noise 
scenarios. Thirdly, the performance of Fractional Sampling (FS) based SS is studied and a method for determining 
the operating point for the FS rate in terms of sensing performance and complexity is suggested. Finally, an SNR 
estimation technique based on the maximum eigenvalue of the received signal's covariance matrix is proposed. It 
is shown that proposed SCN-based threshold improves sensing performance in the presence of correlated noise and 
SNRs upto dB can be reliably estimated without the knowledge of noise variance. 
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I. Introduction 

Spectrum Sensing (SS) plays an important role in Cognitive Radio (CR) networks in order to acquire the 
spectrum awareness required by CRs. The three main signal processing techniques for sensing the presence 
of a primary user (PU) that appear in the literature are matched filter detection, Energy Detection (ED) 
and cyclostationary feature detection [1]. Matched filter detection and cyclostationary feature detection 
techniques require the prior knowledge of the PU's signal to make the decision about the presence or 
absence of the PU signal [2]. Although ED technique does not require any prior knowledge of PU's 
signal, the performance of this technique is susceptible to noise covariance uncertainty [3]. Since both 
the prior knowledge about the PU's signal and the noise variance are unknown to the CRs in practical 
scenarios, exploring efficient and blind SS techniques for CRs has emerged as an important research 
challenge. Several blind SS techniques have been proposed in the literature [4-7] without requiring the 
prior knowledge of the PU's signal, the channel and the noise power. Furthermore, the performance of 
traditional SS techniques is limited by received signal strength which may be severely degraded in multi- 
path fading and shadowing environments. Different diversity enhancing techniques such as multi-antenna, 
cooperative and oversampled techniques have been introduced in the literature to enhance the SS efficiency 
in wireless fading channels [8-10]. Most of these methods use the properties of the eigenvalues of the 
received signal's covariance matrix and use recent results from advances in Random Matrix Theory (RMT) 
[11, 12]. The main advantage of eigenvalue based SS over other SS techniques is that it does not require 
any prior information of the PU's signal and it outperforms ED techniques, especially in the presence of 
noise covariance uncertainty [8]. 

In this paper, we use the standard condition number (SCN) of the noise covariance matrix to analyze 
the effect of noise correlation on eigenvalue based SS technique. The SCN of a matrix is defined as 
the ratio of the maximum eigenvalue to the minimum eigenvalue [13] and can be used as a metric to 
characterize the support of the asymptotic eigenvalue probability distribution function (a.e.p.d.f.) of a 
random matrix. Furthermore, we use the SCN of the received signal's covariance matrix for decision 
process. If the calculated SCN is greater than noise only SCN, the decision is that a PU signal is present. 
Since noise correlation affects the SCN of the noise covariance matrix and as a result, the SCN of the 
received signal's covariance matrix, the decision metric is also affected. According to author's knowledge, 
this method has not been considered in the literature for SS in the presence of noise correlation. 

Several blind SS techniques utilizing various features of the received signal's covariance matrix such as 
statistical covariance [14], autocorrelation [15] and eigenvalue distribution [8] have been proposed in the 
literature. In most of the existing eigenvalue based SS literature, the authors consider asymptotically large 
matrices whose eigenvalues are known to follow the Marchenko-Patur (MP) law, which establishes the 
convergence of the largest and smallest eigenvalues of these matrices. The authors in [16] use this MP law 
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to test a binary hypothesis under white noise conditions using SCN for Wishart matrices. However, the 
sample covariance matrix of the noise is not a Wishart random matrix in the presence of correlated noise 
[8]. In practical situations, noise correlation arises due to oversampling and imperfections in filtering [8]. 
For example, when a narrowband signal is sampled with a sampling rate greater than the symbol rate, 
the noise sequence is not white. In case of noise correlation, the eigenvalue distribution does not follow 
the MP law and the SCN threshold proposed in [16] may result in degraded PU sensing performance. 
Therefore, new SCN-based sensing thresholds need to be investigated for carrying out SS in the presence 
of noise correlation. This is the first contribution of this paper. 

Furthermore, several methods based on eigenvalue distribution of received signal's covariance matrix 
usually focus on interweave CR meaning that Secondary User (SU) transmits only when no PU signal is 
present [8,9]. However, if side information is available about the primary Signal to Noise Ratio (SNR), 
advanced underlay transmission schemes could be employed at CRs. In practical scenarios, it would be 
advantageous to estimate the primary SNR in order to decide the transmission strategy of the cognitive 
transmitter. Depending on the estimated primary SNR level, different underlay transmission strategies 
(e.g. cognitive resource allocation) can be implemented at cognitive transmitter to allow the coexistence 
of primary and secondary systems. In this direction, we derive the a.e.p.d.f. of received signal's covariance 
matrix for signal plus noise case under white and correlated noise. The a.e.p.d.f. is then used to determine 
the maximum eigenvalue which is in turn exploited to estimate the SNR. Moreover, the SNR estimation 
performance is evaluated based on normalized mean square error (MSB). This is the second contribution 
of this paper. 

The sampling rate in the receiver can be increased beyond the symbol rate, known as fractional sampling 
(FS), to enhance SS efficiency under fading channel conditions. FS is commonly used to enhance signal 
detection reliability in the receiver [17-19]. From the CR point of view, an FS receiver can be modeled 
as a virtual multiple-output system with presumably independent channel fading effects. This technique 
is especially beneficial in time varying channels with large Doppler spread, i.e. small channel coherence 
time. Another motivation for introducing the FS concept in the context of CR is that using more antennas 
at the receive-side is often impractical and expensive requiring multiple RF chains. In wireless fading 
environments, FS introduces diversity and can improve signal detection. However, FS also results in 
colored noise when the bandwidth of receive filter is not sufficiently large [20] and this phenomenon 
gradually saturates the performance gain due to FS [17, 19]. Therefore, it is important to determine the 
operating point for the FS rate, a design parameter that we can actually configure to find a good trade-off 
between performance and complexity. This is the third contribution of this paper. 

The remainder of this paper is structured as follows: Section II reviews in detail prior work in the areas 
of eigenvalue based sensing. Section III describes the considered signal models under white or correlated 
noise scenarios. Section IV analyzes the effect of noise correlation for the noise only case and proposes 
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new SCN-based decision bounds. Section V provides the analysis for signal plus noise case under white 
or correlated noise and describes the purposed eigenvalue based SNR estimation method. Section VI 
studies the performance of proposed techniques with numerical simulations and proposes a method for 
determining the optimal FS operating point. Section VII concludes the paper. The appendix includes some 
preliminaries on random matrix transforms. 

A. Notation 

Throughout the formulations of this paper, ¥,[■] denotes the expectation, (■)^ denotes the conjugate 
transpose matrix, abs(-) denotes the absolute value, and (■)^ denotes the Hermitian transpose matrix, 5x 
represents Stieltjes transform of X, T^x represents R transform and Ex represents E transform [11]. 

II. Related Work 

The three major eigenvalue based sensing techniques considered in the literature are [8]: Maximum- 
Minimum Eigenvalue (MME) detection. Energy with Minimum Eigenvalue (EME) detection and Maxi- 
mum Eigenvalue Detection (MED). A number of eigenvalue based SS methods are proposed in [8, 10, 
16] utilizing eigenvalue properties of Wishart random matrices, which arise under noise only cases in 
white noise scenarios. The authors in [16] use MP law to test binary hypothesis problem. In [8], the 
Tracy-Widom (TW) distribution is used as a statistical model for the largest eigenvalue and both the TW 
distribution and the MP models are used to find the approximate distribution of random SCN and this 
distribution is used to derive the relationship between an expression for probability of false alarm (Pf) and 
threshold. The difference between the MP approach and the TW approach is that MP is a deterministic 
function which characterizes the asymptotic matrix spectrum, while TW approach provides the statistics of 
individual eigenvalues e.g. the maximum eigenvalue. Since the rate of convergence of the TW distribution 
is faster than MP law, the TW method is superior than the MP only method. However, the TW method 
outperforms the MP method only at relatively large SNRs since SCN is a ratio of two random variables 
and the approximation considered in [8] is accurate only for large SNR conditions. 

In [10], an approximation of the threshold function is derived for systems having equal number of 
receiving antennas and samples. In [21], the p.d.f. of the eigenvalue ratio has been derived using the 
expression of the joint distributions of an arbitrary subset of ordered eigenvalues of complex Wishart 
matrices. In this scenario, the receiver should be provided with a look-up table in order to calculate 
the proposed inverse cumulative distribution function of the second-order TW distribution. The exact 
distribution of the condition number of a complex Wishart matrix has been used to calculate the threshold 
expression in [10] without the need of a look up table. However, the calculated threshold expression in 
terms of Pf in [10] is based on the exact density of the condition number of complex Wishart matrix 
considering the noise only case and it is only valid in case of white noise measurements. For the correlated 
noise case, the sample co variance matrix does not follow the properties of Wishart random matrices. 
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In [22], a more accurate model considering the Trace- Widom-Curtiss (TWC) model has been considered 
by using the distribution of the smallest eigenvalues of Wishart random matrices. However, the TW 
distribution and the Curtiss' ratio of variates formula are highly involved functions, which are hard to 
evaluate numerically and non tractable to find the support of a.e.p.d.f. [23]. In [23], the exact distribution 
of SCNs of dual Wishart random matrices has been used and it is argued that the proposed method 
requires only tens of samples and outperforms all the RMT based techniques. However, the authors in 
[23] considered the Wishart random matrix model for signal plus noise case for simplicity and did not 
address the fact that during the presence of signal and correlated noise, the sample covariance matrix 
may no longer be a Wishart random matrix. In [24], non-asymptotic behavior of eigenvalues of random 
matrices has been considered using the spectral properties of random sub-Gaussian matrices of fixed 
dimensions. A cooperative SS algorithm using double eigenvalue threshold has been proposed in [25], 
which considers two maximum eigenvalues for the noise only and the signal plus noise cases through 
analysis of sample covariance matrix of received signals using RMT approach. 

Spectrum sensing using free probability theory has also received important attention in the literature 
[26] [27]. In [26], a cooperative scheme for SS has been proposed using asymptotic free behavior of 
random matrices and the property of Wishart distribution. The same work has been extended for MIMO 
scenario in [27]. In these works, the presence of the PU signal is decided simply by checking whether 
the power matrix is zero or not but this technique is not studied analytically in [26] and [27]. 

III. Signal Model 

Let us consider a single cognitive user and a single primary user for simplicity of analysis. Let N be 
the number of samples analyzed by the cognitive user for the decision process in the time duration of r 
while performing symbol rate sampling. The sampling rate in the receiver can be increased beyond the 
symbol rate to enhance the signal detection capability in wireless fading channels. This technique known 
as FS [17] produces FS samples out of each original sample. Let M be the FS rate carried out at the 
input of cognitive receiver. From signal model point of view, this factor can be considered as the number 
of multiple outputs analogous to the number of cooperating users in cooperative based sensing or the 
number of antennas in multiple antenna sensing as considered in related literature [8, 16]. We denote the 
hypotheses of the presence and absence of the PU signal by Hi and Hq respectively. A binary hypothesis 
testing problem for k-th FS branch, k — 1, M, can be written as: 

Hq : yk{i) = PU absent 

Hi : yk{i) = hk{i)s{i) + Zk{i) PU present (1) 

where yk{i) is the signal observed by a A;-th receiving dimension at i-th instant, i = 1,2, ..,iV, s{i) is 
the PU signal at i-th instant, which is to be detected, hk{i) is the amplitude gain of the channel for k-th 
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receive dimension at i-th instant, and Zk{i) denotes the colored noise for k-th receive dimension at i-th 
instant. For our analysis, we assume that transmitted symbols are independent and identically distributed 
(i.i.d.) complex circularly symmetric (c.c.s.) Gaussian symbols, the noise samples in each FS branch are 
independent but are correlated across FS branches. 

The M X N channel matrix H consists of i.i.d. coefficients and each row of H represents the channel 
coefficients for N number of samples for each FS branch i.e. H = [h]^,h2,...,hjy^J , with = 
[ /irn(l) ^m(2) ■ ■ ■ hm{N) ] with m — 1,2, M. We assume channel coefficients to be i.i.d. in each 
FS branch and the channel coherence time to be sufficiently small so that channel is not correlated as we 
increase the FS rate. 

While performing sensing in a cognitive receiver, the sensing duration (r) and symbol interval (Tg) may 
not be the same depending upon the signal bandwidth and sampling rate used at the receiver. For example, 
let us consider a coexistence scenario of TV whitespace broadband and wireless microphone systems. 

These are two systems with different operation bandwidths, a microphone signal typically occupies 200 
kHz bandwidth while TV signal occupies 6 MHz and microphone operates on TV bands [8]. In this 
scenario, r becomes much greater than T^. Under the Hi hypothesis, we consider the following signal 
models considering the relation between r and Tg. 

Case 1: In this case, we consider that the transmitted symbol remains constant during the sensing 
period. The received signal matrix in this case can be written as: Y = y^Hs + Z, where s is a 
constant transmitted symbol, p is the power of transmitted symbol and Z = [zf , z^, z|^]^, with 
Zm — [ -Sm(l) -Sm(2) ■ ■ ■ Zm{N) ] . In this casc, the sample covariance of transmitted signal can 
be written as: Rg = E[s^] = 1. 

Case 2: In this case, each fractional sampled branch i.e. each row of matrix Y includes the samples 
for a single symbol. Y = ^HS^ + Z, where is the diagonal transmitted signal matrix of dimension 
N X N with diagonal s = [s(l)...s(A/^)]. In this case, the sample covariance matrix of the transmitted 
signal becomes 



E[S,Sf] 



E[s2(l)] 
E[s2(2)] 








(2) 





assuming that for each sample we get an i.i.d. c.c.s. Gaussian symbol with E[s^] = 1. 
The M X N received signal matrix Y in both cases can be written in the following form: 



" yi 






yi(2) . 


■ yi{N) 


y2 




1/2(1) 


Z/2(2) . 


■ y2{N) 


. yM 




_ I/m(1) 


I/m(2) . 


■ VMiN) 



(3) 
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Assuming that the source signal is independent from the noise, the covariance matrix of received signal, 
Ry, is given by [8]; 

Ry = E[YY^] - E [(VpHS)(VpHS)^] + E[ZZ^] - pHH^ + R^ (4) 

where — E[ZZ^]. Let us define sample covariance matrices of received signal and noise as: Ry(^) ~ 
j^YY^ and Rz;(iV) = -^ZZ^. The received signal Y can be further written as: 

a/pHs + Z, Case 1 

- (5) 
Y^HS(i + Z, Case 2 

where Z ~ CJ\f{0,'R^{N)) is the colored noise. The SCN of R^{N) depends on the noise correlation 
among noise samples across FS branches. 

A. Noise Correlation Modeling 

To analyze the noise correlation effect mathematically, a simple correlation model should be employed. 
In this work, we consider one-sided noise correlation model. Using this model, the colored noise can be 
related to the white noise using the following expression. 

Z = 0i/2z (6) 

where Z is an M x A?^ matrix with c.c.s. i.i.d. Gaussian entries with zero mean and unit variance, 
representing the white noise and is an M x M Hermitian matrix whose entries correspond to the 

correlation among noise samples across FS branches. To ensure that © does not affect the noise power, 
we consider the following normalization: 

(1/M)trace{e} = 1 (7) 

The noise covariance matrix depends on the transfer function of the pulse shaping filter used at the input 
of RF front end of a CR. Most SS-related papers consider baseband processing without including the 
effect of the filter on the received signal and they further assume the noise to be white in many scenarios. 
In practical implementation of a CR, the received signal should be passed through a pulse shaping filter 
before further processing and thus noise is no longer white. Due to absence of channel knowledge and 
PU signal, coherent receivers such as matched filter (i.e. receive part of root raised cosine filter) are not 
suitable for the SS application. Active RC filters with tunable cut off frequencies has been proposed in 
literature for CR applications [28] [29]. When a white noise input process with power spectral density 
Nq/2 is the input to a RC filter with time constant RC, the noise is colored after filtering. Although the 
channel may also get correlated at the output of the filter, we are interested in analyzing the effect of noise 
correlation on SS performance in this work assuming that noise correlation effect dominates the overall 
effect. The RC filter transforms the input autocorrelation function of white noise into an exponential 
function given by [30]: Ryii^) — Since the autocorrelation function of output process of RC 
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filter resembles the exponential model, we consider exponential correlation to model in this work. The 
exponential correlation model can be written as [31,32]: 

( pabs(i-i)^ ■ < j 

where 6ij is the (i, j)-th element of S and p e C is the correlation coefficient with | p |< 1. 

IV. Analysis under Hq hypothesis 

RMT has been used in the literature in various applications such as modeling transmit/receive correlation 
in MIMO channels and multiuser MIMO fading [32, 33]. Here, we state two RMT based theorems which 
are going to be used in defining our decision statistics. 

Theorem 4.1: [11] Consider an M x N matrix F whose entries are independent zero-mean complex 
(or real) random variables with variance ^ and fourth moments of order O(^). As M,N ^ oo with 
^ — > ^, the empirical distribution of the eigenvalues of ;^FF^ converges almost surely to a non random 
limiting distribution with density given by: 

where a = (1 — 6 = (1 + \f^Y. The parameters a and h define the support of the distribution and 

correspond to the minimum eigenvalue {Xmin) and the maximum eigenvalue {Xmax) respectively and the 
ratio h/a defines the SCN of ;^FF^. The above limiting distribution is the MP law with ratio index /3. 

I 

Remark 4.1: In practice, we can have only finite number of samples and the sample covariance matrix 
Ry{N) may deviate from the covariance matrix Ry [8]. The eigenvalue distribution of Ry{N) becomes 
complicated due to requirement of consideration of finite parameters in the analysis. This makes the choice 
of the threshold difficult for SS purpose and the performance of SS algorithms becomes sensitive to the 
choice of threshold at low values of SNR. Although various TW approaches have been proposed in [8] 
and [22] for accounting the random nature of SCN of finite matrices, we are interested in analyzing the 
correlation effect on MP based asymptotic methods in this paper. 
In this noise only case, Ry(-?V) becomes equal to Rz;(-/V) and can be written as: 

RY(iV) = Rz(^) = 0^/^ZZ^0^/2 (10) 

Ry(-/V) converges to Ry for A?^ — > oo [22] and asymptotic analysis still holds true for large values of N 
[16]. Furthermore, Rz{N) — ;^ZZ^ is nearly a Wishart random matrix [11] in white noise scenarios but 
is no longer a Wishart random matrix in correlated noise scenarios. 

To calculate the threshold for SS purpose, we need the support of a.e.p.d.f. of Y, namely, X„iax and Xmin- 
Due to noncommutative nature of random matrices, it is not straightforward to calculate the eigenvalue 
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distribution of Y by knowing the eigenvalue distribution of and Z. Using free probability analysis, the 
asymptotic eigenvalue distribution of ;^YY^ can be calculated by applying the S transform [11] 

Sy(z) = Se(^)Sz(z) (11) 

where S@ and Sz are the S transforms of the densities of eigenvalues of and ;^ZZ^ respectively. 
Since is a square matrix, 0^/^ZZ^0^/^ and 0ZZ^ have identical eigenvalues [11]. Using eqn. (|35l) , 
T.y{z) can be written as: 

EY(;2) = Se(z)-^ (12) 

The E transform of corresponding asymptotic eigenvalue distribution ^©(z) can be obtained by choosing 
a proper model for noise correlation. The asymptotic density of eigenvalues of can be described as a 
tilted semicircular law [33], which is a close approximation for the exponential model and is analytically 
tractable. This density can be described using the following theorem. 

Theorem 4.2: [33] Let be a positive definite matrix which is normalized as: (1/M)trace{0} = 1, 
and whose asymptotic spectrum has the p.d.f. 



with cTi < A < (72 and fi = ■ If F is an M x standard Gaussian matrix as defined in theorem 

1, then as M, iV cx) with ^ -> the asymptotic distribution of W = 01/2^^^^01/2 j^^g jj^g following 
p.d.f. 

JiX-a)+{b- X)+ 
^-(^)-('-™+ 2.A(1 + A,) 

where 

a = 1 + /3 + 2/i/3 - 2v^V(l + + fi/3) 

b = 1 + /3 + 2/i/3 + 2v^V(l + + IJ.I3) (15) 

The parameters a and b correspond to Xmm and Xmax respectively and the ratio b/d defines the SCN of 
W. 

■ 

The eigenvalue spread of is related to the degree of noise correlation i.e. a zero eigenvalue spread 
corresponds to a zero-correlation model = Im and higher spreads are associated with higher correlation 
modes. In (14), the parameter fi controls the degree of noise correlation and varies the support of the 
distribution i.e. for jj, = 0, d = a and b = b. For the exponential correlation model as stated in [33], the 

2 

parameter fi is related to correlation coefficient p with the following relation: fi = jz^. Furthermore, the 
SCN is related to p with the relation SCN = j^. To calculate in a practical cognitive receiver, the value 
of p can be determined from FS rate based on some empirical model constructed from measurements. In 
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our results, we employ a simple linear model to study the effect of noise correlation as FS rate increases 
(see Section VI C). 

It can be noted that MP law can be used as a theoretical prediction under the Hq hypothesis with white 
noise [16]. The support of the eigenvalues of the sample co variance matrix under the Hq hypothesis is 
finite independently of the distribution of the noise. To decide the absence or presence of signal under 
white noise, the deviations of distribution of eigenvalues from the normal bounds a and b of MP law can 
be used. If the eigenvalues appear outside these bounds, then it can be decided that there is presence of PU 
signal and if all the eigenvalues lie within the bounds of MP law, it can be decided that there is absence 
of PU signal. In case of noise correlation, the bounds of eigenvalue distribution of sample covariance 
matrix become different than the bounds obtained in white noise case and MP law no longer applies. The 
new bounds (a, b) depend on the noise correlation parameter /x. We present the sensing example with new 
bounds for FS scenario in the following subsection. 

A. Sensing With FS 

The parameter /i depends on the sampling rate applied in the receiver since noise correlation increases 
along with the sampling rate. Sampling rate can be varied from the symbol rate to some order of the 
symbol rate and the effect of sampling rate on sensing performance can be evaluated by varying the 
correlation effect. Let us consider that both noise distribution and noise variance are unknown to the 
detector to reflect the practical scenario. The SCN under the Hq hypothesis does not depend on noise 
variance. Under white noise scenario, Hq hypothesis is decided if SCN < ^ and Hi is decided in all 
other conditions [16]. Similar decision process can be applied for correlated noise case and the decision 
can be made on the basis of the following condition: 



When FS rate M is applied at the CR, M rows of sample covariance matrix become correlated. The value 
M = 1 corresponds to the symbol rate sampling and correlation coefficient p = 0. Since the the value of 
p varies from to 1, the relation between the FS rate M and the correlation coefficient p is considered 
as a simple linear model Q as shown below 




(16) 




(17) 



where f3 = N/M and e is a parameter defining the slope of the linear dependence. 



More exact relation models can be acquired through measurements on the CR equipment. 
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V. Analysis under Hi hypothesis 

A. White Noise 

Assuming that signal and noise are independent, for very large value of N, eqn. ^ leads to the 
following approximation [8]. 

Ry(A^) ~ pHH^ + Rz(A^) (18) 

In white noise case, the sample covariance of received signal under assumed conditions can be realized 
as the sum of two Wishart matrices i.e. pHH^ and ZZ^ with same degree of freedom and different 
covariance structures. In this condition, MP law holds true for both matrices. Although it is possible to 
find another Wishart matrix from the the addition of pHH^ and ZZ^ approximately (see Lemma 6, [34]) 
and then apply scaled MP law by scaling with variance (l+p"^) for the new Wishart matrix, we use free 
probability theory for more accurate analysis. The R transform of eigenvalue density function of YY^ 
can be found by adding the R transforms of density functions of pHH^ and ZZ^ using free probability 
theory. Using eqn. (|34l ). the R transform of pHH^ can be written as: 

Since the R transform of ZZ^ is T^z^h^ {z) = from eqn. (|33l) . the combined R transform can be written 
as: 

{z) = -^ + -^ (20) 

1 — pz 1 — z 



The inverse Stieltjes transform can be obtained by applying eqn. (1201) on eqn. (1321) . Then the Stieltjes 
transform can be obtained by solving the following cubic polymonial. 

{yp)S{zf + {p{-2f3 + ^ + 1) + z)S{zf + ((1 - /3)(1 - p) + z)S{z) + 1 (21) 
B. Correlated Noise 

Using the similar arguments as in the above subsection, the following approximation can be written for 
correlated noise scenario. 

Ry {N) ^ pHH^ + R2 (N) (22) 

In correlated noise case, the sample covariance of received signal under assumed conditions can be realized 
as a sum of one Wishart matrix i.e. pHH^ and another correlated Wishart matrix ZZ . In this condition, 
MP law can be applied for pHH^ and the analysis carried out under Hq hypothesis in section IV can be 
applied for ZZ . Then the R transform of density function of the received signal can be found by adding 
the R transforms of density functions of pHH^ and ZZ . The Stieltjes transform of ZZ can be written 



as [33]: 

z + 2zfi + l- (3 + y/[z - {1 + f3)]^ - 4f3{l + nz) 
2z{l + nz) 



Stt"^^) = , ... ' — (23) 
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Then the R transform for ZZ is calculated using eqn. (|32l ) and can be expressed as: 



1 - 1 + J{z^ -2z + l- AfiPz)) 
--^^^^ = -2 ITz 



(24) 



The combined R transform then becomes 



p/3 1 



l{-l + z+ ^{1 -2z + z^- Aij/Sz)) 



(25) 



(l-pz) 2 




The inverse Stieltjes transform can be obtained by applying eqn. (1251) on eqn. (|32l) and the Stieltjes 
transform can be obtained by solving the following quatric polymonial. 

+ l^z))S{z)^ + {2zi2p{z - pP) + p\l + 2zfi + z- 2/3) + 2zp)S{z)'^ + 
{p\l2{l - /3)2 + 1 - /3) + 2p{l + Z + fiz{2 -/?)) + z - 3p/3 + z''fi)S{zy + 



We can find the roots of the above polymonial in closed form. The closed form is not specifically written 
in this paper because it includes many terms which provide no further insight. The support of a.e.p.d.f. 
of -^YY^ under correlated noise is calculated based on eqn. (l26l) . Since we know the value of /3 and 
we can measure the value of p, we can find the value of p by sensing the maximum value of ^^YY^. 
Look up tables are provided for convenience in order to estimate the SNR of the PU (see Section VI B). 
We consider the following three cases: (i) signal plus correlated noise, (ii) correlated noise only, and (iii) 
signal plus white noise. In the look up table, we present the maximum eigenvalues of received signal's 
covariance matrix for above three cases for different values of SNR and (3. The eigenvalue distribution 
for signal plus white noise case is obtained using polymonial eqn. (1211) and for signal plus correlated 
noise case is obtained using polymonial eqn. (|26)) . We can predict the received SNR of PU signal based 
on the maximum eigenvalue. The parameters /3 and p are assumed known as operating parameters of the 
sensing module. Based on this estimated SNR, we could potentially design suitable underlay transmission 
strategy for secondary transmission. In section VI, we provide the normalized MSB versus SNR plot (see 
Fig. 7) to evaluate the performance of this estimation technique. 



In this section, we study the performance of eigenvalue based sensing in the presence of noise correlation 
with proposed decision bounds. The decision statistic for MP law is calculated as: 



{2p{l + - /?)) + z{l + 2/i) - +p) + l)S{z) + 



(26) 



VI. Numerical Results 




(27) 
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and proposed decision statistic is calculated based on eqn. (fT6l) . which can be rewritten as: 

decision =/ < I (2^, 

I Hi, Otherwise 

The ratio of correct sensing is used as a performance metric to analyze the performance and it is 
defined as the ratio of number of correct sensing to the number of total considered iterations under both 
hypotheses. In the presented simulation results, 10^ iterations were considered. 

Furthermore, we present SNR estimation method under Hi hypothesis. The normalized MSB is consid- 
ered as a parameter to characterize the performance of proposed SNR estimation technique and is defined 
as: 

MSE = ^' (29) 

T 

where 7 is the estimated SNR with the proposed method and 7 is the actual SNR. 
A. Eigenvalue SS 

The performance of proposed sensing scheme has been analyzed in Rayleigh fading channel. White 
and correlated noise scenarios have been considered in the analysis. In case of white noise scenarios, it 
has been noted that the eigenvalue distribution of received signal's covariance matrix follows MP law and 
the distribution is limited to the bounds given by MP law. Therefore, the decision rule in eqn. (l27l) is used 
for sensing of the PU signal. However, in case of noise correlation, the eigenvalue distribution breaks 
into two parts (Fig. 2, [32]) and the decision rule in eqn. (|28] ) is considered. The ratio of correct sensing 
versus SNR for p = 0.5,(3 = 1/6 is depicted in Fig. 1. It can be observed that sensing with eqn. (1281) 
outperforms than sensing with eqn. (ITTI) in correlated noise case. Figure 2 shows the sensing performance 
versus correlation coefficient at SNR value of -6 dB and (3 = 1/6 and it can be noted that with increased 
amount of noise correlation, the sensing with MP bounds decreases drastically and sensing with eqn. (l28l) 
gives better performance up to some value of correlation. Moreover, it has been noted that new bounds 
also do not provide better sensing at high correlation region. This is due to the fact that the threshold 
increases and the asymptotic eigenvalue support of Hi is subsumed in the one of Hq at this region. To 
study the effect of correlation on eigenvalue based spectrum sensing under Hi hypothesis, simulations 
were carried out in correlated and white noise scenarios. Hi hypothesis case was considered by taking the 
combination of signal and noise in both scenarios. Figure 3 shows the theoretical and simulated eigenvalue 
distribution of covariance matrix of received signal i.e. -^YY^ for SNR=-2 dB and /3=1 under white noise 
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case. The histograms of the eigenvalues were created by accumulating the eigenvalues over 10^ iterations. 
The theoretical result was obtained by evaluating the polynomial given by eqn. (|2T)) . Similarly, Fig. 4 
shows the eigenvalue distribution of covariance matrix of received signal for SNR=-2 dB, SCN=3 and 
(3=1 under correlated noise. In this case, theoretical result was obtained by evaluating the polynomial 
given by eqn. (|26l) . From figures 3 and 4, it can be observed that the theoretical and simulated density 
functions perfectly match. 

To observe the variation of the maximum eigenvalue of received signal's covariance matrix with respect 
to SNR, we present the maximum eigenvalue versus SNR plot in Fig. 5 for both correlated and white noise 
cases. From the figure, it can be observed that the maximum eigenvalue has higher value in correlated 
scenario than in white noise scenario over the considered range of SNR (from -10 dB to 2 dB) and the 
gap between these two curves goes on decreasing while increasing the value of SNR. 

Figure 6 shows the plot of maximum eigenvalue of received signal's covariance matrix versus SCN of 
correlation matrix for the following three cases (i) signal plus correlated noise case, (ii) correlated noise 
only case and (iii) signal plus white noise case. It can be observed that the maximum eigenvalue for the 
first case is greater than maximum eigenvalue for the second case and the difference remains more or less 
consistent for all considered values of SCN (from 2 to 20). With respect to white noise case, maximum 
eigenvalue in correlated case increases almost linearly with the value of SCN. 

B. SNR Estimation 

Table 1 shows the look up table for different values of SCNs of the correlation matrix. This table can 
be used to estimate the SNR of the PU signal based on the values of SCN and /3 for both correlated 
and white noise cases. The value of SCN can be derived from the measurements of p. For example, 
if the value of SCN is 2, /3 is 1 and maximum eigenvalue of covariance matrix of received signal i.e. 
^YY^ is 5.93, we can estimate that the received SNR of PU signal is dB and intermediate values 
can be calculated through interpolation. Based on this estimated SNR, we can design suitable underlay 
transmission strategy for secondary transmission. From the table, it can be observed that at lower SNR 
values, the difference in maximum eigenvalue of signal plus correlated noise case and correlated noise 
only case becomes very small and it becomes difficult to distinguish signal from noise and furthermore, 
this effect becomes more prominent at higher values of SCN. 

Figure 7 shows the normalized MSE versus SNR plot for signal plus correlated noise case for different 
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SCNs of the noise correlation matrix. From the figure, it can be observed that for all values of SCN, 
normalized MSB decreases with the SNR. We can estimate the SNR with 10 % normalized MSB upto -1 
dB and after 3 dB, we can estimate with normalized MSB of 1 %. From the figure, it can be noted that 
the normalized MSB becomes almost stable if we go to higher SNR values beyond 3 dB and it increases 
for higher values of SCN at lower SNR values. 

C. FS Operating Point 

Figure 8 shows the ratio of correct sensing versus FS rate (Af) for e = 3.5. The FS rate has been 
increased from 1 to 11 and noise correlation has been calculated using eqn. (fTTl ) for different values of 
M. It can be noted that the sensing performance increases with the FS rate for white noise scenario. 
However, at the same time, noise becomes correlated due to FS and increasing the sampling rate does 
not monotonically increase the performance. From Fig. 8, it can be noted that for iV=60, SNR=-5 dB, the 
performance increases up to FS rate M = 8 and for M > 8, the sensing with eqn. (l28l) saturates. It can be 
observed that increasing sampling rate enhances the sensing performance up to a certain FS rate, however, 
this also increases the complexity in the receiver. Thus it can be concluded that optimum sampling rate 
should be chosen at the receiver without increasing further complexity since larger rate does not enhance 
the performance due to noise correlation. 

VII. Conclusion 

In this paper, the performance of eigenvalue based sensing has been analyzed in presence of noise 
correlation. This case often appears due to imperfections in filtering or oversampling and results in non- 
Wishart co variance matrices. A new SCN-based threshold has been proposed for improved sensing in 
the presence of noise correlation. Furthermore, an SNR estimation technique based on the maximum 
eigenvalue of received signal's covariance matrix has been proposed and the performance of proposed 
technique has been analyzed with normalized MSB. It has been shown that SNRs upto dB can be reliably 
estimated without any knowledge of noise variance. Moreover, the performance of FS based SS technique 
is studied and it has been noted that SS efficiency increases with FS rate up to a certain limit and it 
does not provide performance advantage beyond this limit. Therefore, it can be concluded that an optimal 
operating point for the FS rate should be selected to maintain a good trade-off between performance and 
complexity. 
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APPENDIX 

Random Matrix Theory Preliminaries 

Let -Fx(x) be the eigenvalue probability density function of a matrix X. 

Theorem 7.1: The Stieltjes transform S^{z) of a positive semidefinite matrix X is defined by [11] 

1 



X-z 



OO -| 

T dF^{\) (30) 



The a.e.p.d.f. of X is obtained by determining the imaginary part of the Stieltjes transform 5x for real 
arguments: 

lim -lm{S^{x + jy)} (31) 
Theorem 7.2: The R transform is related the inverse of Stieltjes transform by the relation [11]: 

^x(^) = 5x'(--2)-- (32) 

z 

Theorem 7.3: For a Wishart random matrix X, the R transform of the density of eigenvalues of XX^ 
is defined as [11]: 

n^{z) = (33) 
I — z 

For any a > 0, 

7^ax = a7^x(a-^) (34) 
Theorem 7.4: For a Wishart random matrix X, the E transform of the density of eigenvalues of XX^ 
is defined as [11]: 

Ex(.) = (35) 
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Fig. 1. Sensing performance versus SNR with eqn. (27) and (28) (/3 = 1/6, p = 0.5) 
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Sensing performance versus correlation coefficient in presence of white and correlated noise (SNR= 



-6 dB, 13 = 1/6) 
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Fig. 3. Theoretical and simulated eigenvalue distribution of signal plus white noise for SNR= —2 dB, /3=1, = 50 
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Fig. 4. Theoretical and simulated eigenvalue distribution of signal plus correlated noise for SNR= —2 dB, 13 = 1, SCN= 3, A'^ = 50 



TABLE I 

Look up table for different values of condition numbers 
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Fig. 5. Maximum eigenvalue versus PU SNR for correlated and white noise case (SCN= 3, /? = 1) 
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Fig. 6. Maximum eigenvalue versus SCN for correlated and white noise case (SNR= —2 dB, j3 = 1) 




Fig. 7. Normalized MSE versus SNR for SNR estimation using proposed technique 
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Fig. 8. Sensing performance versus FS rate (A^ — 60, SNR= 



-5 dB) 



